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In the Specification: 

Page 1, lines 3-5 

BPaedl Eield of the Invention: 

The present invention relates to label printing and more particularly to inspecting printed labels. 
Page 1, lines 14-21 

Automatic label inspection using machine vision is possible. However, labels often use colors 
and materials which make it difficult if not impossible to effectively inspect labels using 
relatively simple binary or gray scale inspection technologies. Presently in some situations, 
colored labels are automatically inspected using a "golden template". With such systems A an 
image of the label isacquired by a machine vision system. The acquired image is then 
automatically compared to the golden template. Various known computerized image correlation 
techniques can determine if the quality of ihe acquired image matches established the "golden 
template". 

Page I, lines 28-29 

The present invention is [ direct ] directed to providing [ an providing ] an improved label [lable] 
inspection system. 

Page 2, lines 2-12 

The present invention provides an automatic label inspection system that is relatively 
inexpensive, flexible and easy to set up. The system and method of the present invention 
[ttSifees] utilize digital watermarks. With the present invention^ a digital watermark is embedded 
in a label. As is conventional in watermark technology [ technologyh ], the digital watermark is 
duplicated many times in the image. That is, the. image printed on the label is divided into areas 
and a copy of the watermark is embedded into each area. Conventional digital watermarks often 
include both a grid and a payload signal. The present invention merely requires use of the 
watermark grid signal. A label is inspected by reading the watermark grid signal from each area 
of the image. The strength of the watermark grid signal in each area is used as a measure of the 
quality of the printing on the label in that area. 
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Page 3 7 lines 2-10 

The term label as used herein means any printed image or text tliat appears on a package ot item. 
The printed image can include text and graphic material or pictures. A label can be [a] relatively 
small such as die type of label that provides a notice required by the FDA on a medicine 
bottle , ffeetttesl A label may be relatively large such as the label that would appear on the side of 
a box containing a refrigerator, A label may be glued to an item or it can be text and graphic 
material printed on a box such as the text and images that appear on many cereal boxes. A label 
consists of an image printed on a carrier. The carrier can be paper, cardboard or plastic. 

Page 3, lines 24-30: 

Figure 1 illustrates a printed label 10L A watermark is redundantly embedded into the image. It 
is noted that the label 101 has some background coloring into which a watermark can be 
embedded. The label shown in Figure I may be a gray scale or a multicolor image. The 
technology for embedding watermark into such images is well known. The shapes such as 102 
merely indicate that the label includes the type of graphic that is conventionally on labels. The 
lines 105 indicate that the label 101 includes textual material. 

Page 4, lines 2-7: 

The [doted] dotted lines in Figure 1 which divide the image into a number of square areas 
illustrate the fact that the image is divided into areas and die watermark is redundantly embedded 
into each of the areas in the image. The typical image would be divided in areas, the size of 
which, would be in the order of one hundred or two hundred pixels square. The lines in Figure I 
merely illustrate that there are multiple areas into which the watermark [m] is embedded. 

Page 4, lines 9-20 

Figure 2 illustrates a system for practicing die present invention. A package 201 moves along a 
conveyor 202. The package 201 includes a label 210. A camera 21 1 captures an image of the 
label 210 and sends the image to a computer 250. The computer 250 includes a conventional 
operating system (such as for example the Microsoft Widows operating system) and a watermark 
reading program 251. The output of the watermark reading program 251 goes to a comparison 
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program 252 which compares the grid signal in each area to acceptable limits. The camera 21 1 
can be a conventional digital camera. It is noted that in alternative embodiments, instead of 
using a computer with an operating system such as Microsoft Windows, the computer 250 is 
what is termed an "embedded system" program to perform the required tasks and camera 21 1 
can be an analog camera with a suitable capture card.[r] 

Page 4, line 28-Page 5, line 3 

In alternative embodiments, algorithms which determine pass/fail criteria based on neighborhood 
operations are used. For example, a weak [w«ek] grid signal in one tile might be acceptable if 
there were a strong signal in all surrounding (neighboring) tiles. Li other alternative 
embodiments, morphological algorithms are employed to perform erosions, dilations, openings 
and closings, etc. Furthermore, blob labeling with ensuing feature extraction could be used to 
find moment data for qualifying defects. 

Page 5, lines 5-8 

If a label does not meet the required criteria* it is deemed unacceptable* In such a case the 
package with the unacceptable label is either appropriately marked for re-labeling or the package 
is removed from the conveyor for further processing, which can for example^ include re-labeling 
the package. 

Page 5, lines 10-22 

The flow diagram in Figure 5 illustrates how the invention operates. The process begins with an 
image of a label. The image is in digital form. The initial image can either be designed in digital 
form (as is often done) or a physical label can be scanned to create a digital image. As indicated 
by block 501, the image of the label is watermarked. This can be done with a conventional 
watermarking program. During the watermarking operation a grid signal is embedded in each 
area of the image. That is, the grid signal is redundantly embedded in multiple areas of the 
image. This grid signal is embedded in the image by modifying the pixels of the image to embed 
specific spatial frequencies in the image. The changes done to embed these spatial frequencies 
are such that they cannot [ can not ] be recognized by a human observer; however, they can be 
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detected by a watermark reading program. Embedding selected [ spooial ] spatial frequencies in 
an image can be done with conventional watermarking technology- 
Page 5, line 29-Page 6, line 10 

Next as indicated by block 505 the labels are passed by a digital camera f cam e ras ] and an image 
of the label is acquired. The watermark is next read from the acquired image as indicated by 
block 507. Reading the watermark involves determining what spatial frequencies appear in each 
area of the watermark. This operation is done in a conventional manner. Next as indicated by 
block 509 7 a determination is made as to whether the spatial frequencies that represent a grid 
signal are present in each area of the image. That is a a detennination is made as to which areas 
of the acquired image include the grid signal. The result of this operation is data such as that 
shoWQ in Figures 3 and 4. [ th e imag e . ] This can be a simple "yes" no type of operation, or it 
can take into account the magnitude of the various frequencies, hi any event the frequency 
spectrum of [image] the image signal is examined to determine if there is a watermark grid signal 
in each area of the image. 

Page 6, lines 12-14 

If there is no grid signal in an area where there should be a grid signal, the label is rejected. 
Alternatively, if the magnitude of the grid signal in a particular area [egej- is below a preset 
threshold* the label is rejected. 
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Page 6, lines 16-24 

Naturally^ on some labels^ [area] areas of the label are blank, [j-he^^e] Hence, one would not 
expect to find a signal in these areas and these selected [area] areas are ignored. With [ many ] 
existing watermark reading [pse^aw*] programs, the first step performed by the program is to 
determine if the image has been enlarged or rotated. With this application of digital watermark 
technology, those steps are not necessary, since the size of the acquired image is fixed and the 
location of the tiles where the watermark is embedded is kjiown. However, if the speed of the 
[ conv e y ] conveyor is such that synchronization is not easily possible,, the conventional steps used 
to locate an area where a watermark is located could be used. 

Page 7, lines 1-12: 

While the embodiments of the invention described above utilize a conventional watermark grid 
signal, specialized watermark signals could be developed which in some situations would 
provide a better quality measurement for labels. Furthermore, in alternative embodiments of the 
invention, in addition to containing a grid signal, the watermark could contain other data. For 
example, the watermark could include data which allows someone to link to a web site using the 
technology described in PCT publication WO 00/70585 published 1 1/23/00 and entitled 
"Methods and Systems for Controlling Computers or Linking to the Internet Resources from 
Physical and Electronic Objects". [His] This publication is hereby incorporated herein by 
reference. Thus the label inspection process according to the present invention could utilize a 
digital watermark that is placed on the label for other purposes such as for allowing a consumer 
to link to a web site. 
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